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^ ■ Abstract 

^ ' Suppose several two-valued input-output systems are designed by setting the 

■ levels of several controllable factors. For this situation, Taguchi method has pro- 

! posed to assign the controllable factors to the orthogonal array and use ANOVA 

model for the standardized SN ratio, which is a natural measure for evaluating 
the performance of each input-output system. Though this procedure is simple 
and useful in application indeed, the result can be unreliable when the estimated 
I standard errors of the standardized SN ratios are unbalanced. In this paper, we 

treat the data arising from the full factorial or fractional factorial designs of several 
controllable factors as the frequencies of high-dimensional contingency tables, and 
propose a general testing procedure for the main effects or the interaction effects of 
the controllable factors. 

Keywords: Confoundings, Contingency tables, Controllable factors, Covariate ma- 
trix, Generalized linear models. Hierarchical models. Fractional factorial designs. 
Full factorial designs. Standardized SN ratio. Sufficient statistics, Two- valued input- 
output systems. 

1 Introduction 

In this paper, we consider evaluating performance of several two-valued input-output sys- 
tems. Before introducing our motivated problem, first we give a typical example of a single 
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two-valued input-output system and review the measure for evaluating its performance. 
Suppose a vending machine judges an inserted coin as fair coin or false coin. In this 
system, the input is the true state of the inserted coin, {fair, false}, whereas the output 
is the judged state of the coin, {fair, false}. For evaluating performance of this machine, 
prepare ni fair coins and n2 false coins and insert them to the machine. The result of the 
judgment by this machine is summarized as a 2 x 2 contingency table as follows. 





y = l 


y = 2 


total 


M = 


1 


nil 


ni2 


ni 


M = 


2 


n2i 


n22 


n2 



In the above table, two-valued signal M is the true state of the coin, and y is the judged 
state by this machine (1: fair, 2: false). A natural statistical model for this experiment 
is two independent binomial distributions. We introduce random variables, Nii,N2i, and 
parameters Pij, i,j = 1,2, and write A^^i ~ Bin{ni,pii), i = 1,2. pij is the probability 
that a coin of true state i is judged as a state j. Here pn +Pi2 = l,i = 1,2 holds. For this 
type of the systems, the error of judging a fair coin as false (type I error) and the error of 
judging a false coin as fair (type II error) are in the trade-off relation. Therefore we have 
to take into account the two types of errors for evaluating the performance of the system. 
In Taguchi method, a standardized Signal-Noise (SN) ratio. 
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log 



L(i 
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is proposed as a measure to quantitatively evaluate performance of this type of system, 
where 



1 



Po 



is the estimated common error rate, and 



e 



^11^22 
^12^21 



(2) 



is the sample odds ratio. See Taguchi (1987) and Taguchi (1991). Note that the stan- 
dardized SN ratio ([T]) is a function of the sample odds ratio. 

Now we suppose several two-valued input-output systems are designed by setting the 
levels of several controllable factors, which is a situation that we mainly consider in this 
paper. Table[T]is an example of such situations shown in Section 7.3.2 of Miyakawa (2006). 
In this experiment, 40 normal products and 20 failure products are judges whether normal 
or failure, by a testing inspection machine, which makes use of the leaking helium gas, 
in the casing process of a compressor. There are three controllable factors which are 
considered to have influence on performance of the inspection, each of which is settled on 
one of the two levels. In Tabled], the meaning of n^j is the same to the previous example. 
Note that the sample odds ratio is modified as 
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(nii + 0.5)(n22 + 0.5) 
(ni2 + 0.5)(n2i + 0.5)^ 



(3) 
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Table 1: The result of an experiment judging 40 good products and 20 bad products as 
good or bad by a testing inspection machine shown in Miyakawa (2006) 



No. 


A 


B 


C 


nil 


ni2 


n2i 


n22 


Po 


V 


1 


1 


1 


1 


27 


13 


11 


9 


0.435 


-17.689 


2 


1 


1 


2 


25 


15 


3 


17 


0.259 


-5.169 


3 


1 


2 


1 


17 


23 


8 


12 


0.489 


-32.873 


4 


1 


2 


2 


15 


25 


2 


18 


0.320 


-8.295 


5 


2 


1 


1 


40 





12 


8 


0.119 


1.427 


6 


2 


1 


2 


38 


2 


10 


10 


0.203 


-2.638 


7 


2 


2 


1 


40 





11 


9 


0.109 


1.974 


8 


2 


2 


2 


37 


3 


10 


10 


0.234 


-4.037 



Table 2 


Results 


of ANOVA for Table fTl 


Factors 


df 


Sum sq 


Mean sq 


F value p value 


A 


1 


461.35 


461.35 


18.3578 0.02336* 


B 


1 


45.90 


45.90 


1.8263 0.26944 


C 


1 


91.27 


91.27 


3.6319 0.15276 


A X C 


1 


278.17 


278.17 


11.0689 0.04482* 


Residuals 


3 


75.39 


25.13 





since some zeros are included in the table. For this type of the data, Taguchi method has 
proposed to use ANOVA model for the standardized SN ratio. For the data of Table [H the 
main effects and the interaction effects of the controllable factors are evaluated as Table 
[21 Note that we include the interaction effects A x B and B x C into the residuals. This 
result suggests the existence of the interaction effect A x C in addition to the main effects 
A and C. Therefore an optimal condition is considered as A2C1, and the controllable 
factor B does not have a significant influence on performance of the inspection. 

The above procedure is simple and useful in applications. However, it seems that 
the result can be unreliable when the estimated standard errors of the standardized SN 
ratios are unbalanced. This is caused by the fact that the standardized SN ratio is only 
a function of the sample odds ratio, and therefore the sample size for each run is not 
appropriately taken into account in the procedure. To clarify the problem, divide the 
sample sizes for the runs No. 5 and 6 by 4 and 2, respectively, which yields Table |3l 
Of course, the result of ANOVA is almost the same to Table [2] for this situation. Note 
that the difference is only caused by the modification However, it is obvious that 
the relatively good contributions of the interaction effect A x C in the run 5 should be 
underestimate. Consequently, the p value for the interaction effect A x C can increase. 

In this paper, we consider inference for the main and the interaction effects of several 
controllable factors in two-valued input-output systems. For the designed experiments 
with counts data, the theory of the generalized linear models (McCullagh and Nelder, 
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Table 3: Imaginary data set 



No. 


A 


B 


C 


nil 


ni2 


^21 


^22 


1 


1 


1 


1 


27 


13 


11 


9 


2 


1 


1 


2 


25 


15 


3 


17 


3 


1 


2 


1 


17 


23 


8 


12 


4 


1 


2 


2 


15 


25 


2 


18 


5 


2 


1 


1 


10 





3 


2 


6 


2 


1 


2 


19 


1 


5 


5 


7 


2 


2 


1 


40 





11 


9 


8 


2 


2 


2 


37 


3 


10 


10 



1989) are frequently used. See Hamada and Nelder (1997), Chapter 13 of Wu and Hamada 
(2000) or Aoki and Takemura (2006) for example. We also rely on the general theory of the 
generalized linear models and construct a general testing procedure for various hypotheses 
of the interaction effects in Section 2. Note that our settings are not limited to the full 
factorial designs. Considering aliasing relations carefully, fractional factorial designs are 
also treated by our procedure. In particular, we focus on the relation to the models for 
the high-dimensional contingency tables in Section 3. For example, as we will show, the 
data of Table [1] can be treated as 2^ contingency table, and the model A x C is shown 
to be equivalent to one of the hierarchical models for the five- dimensional contingency 
tables. In Section 4, we give some numerical examples and show the effectiveness of our 
procedure. 

2 Conditional tests for the interaction effects of the 
multiple controllable factors 

Suppose there are K two-valued input-output systems, each of which is constructed by 
setting the levels of several controllable factors. As we have seen in Section 1, the obser- 
vation for each run is summarized as 2 x 2 contingency table. We write the observation 
for the kth run as 

nnk,nuk,n2ik,n22k- (4) 

It is natural to suppose an independent binomial model for the observations. We write 
the occurrence parameters as pijk, i,j = 1,2; k = 1, . . . , K, where puk + Pi2k = 1 for 
i = 1,2; k = 1, . . . , K. The likelihood function is written as 

nnn (::::)(:>-' 

where rii.k = nuk + ni2k- In this paper, following the convention of the analysis of the 
contingency tables, we use the similar dot notations to express various marginal totals of 
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the observations. For example, we write 



Tlij. 



K 2 K 

j = l k=l 



k=l 



and so on. 

To express various models for the parameter pijk, we use the theory of the generalized 
linear models. Since we know that the odds ratio 



Oh 



PUkP22k 



Pl2kP21k 

is a good measure for evaluating performance of each system, we assume the structure 
log 9k = Po + PiXki H h Pu-iXku-i, k = 1,...,K 

where x^i, ■ ■ ■ , Xkv-i are the covariates. We write the i/-dimensional parameter (3 and the 
covariate matrix X as 

/3=(/3o,/?i,...,/3._iy (5) 



and 



/ 1 



X 



Xll ■ ■ ■ Xu 



-1 \ 



(1 



K Xi 



y 1 Xki ■■■ Xku-1 ) 

where \k = (1, • • • , 1)' is the i^'-dimensional column vector. We also define the K- 
dimensional frequency vector 

n = (riiii, . . . ,riiix)'. 
Then the likelihood function is written as 



X 2 2 



nnn 

k=l 
K 

n 



k=i i=i j=i 

K 

ni-k \ I n2.k 



ni.k\ f n2.k\ 
nukj \n2ikj 



Pijk 



P21k 



, ■ „ , ^12fc ^'22fc ■ ^ 
k=l v^ll'^/ X^'i^kJ \P22k 

'ni.k\ ( n2.k\n,.,n,., ( P21k^ 



exp(niifc log 9k 



n 

k=l 

■ K 

n 

k=l 

■ K 

n 



Pl2k P22k 



, , v'^'llfc/ V^21fc/ \P22fc 
.k=l 

^ 'ni.k\fn2.k\ na.fe /^P21fc^ 



P22fc 



,fc=l 



P22k 



K 



exp ^ niik log 



exp |^/?ol'i^n + ^ /^jXj-n 
exp {/3'X'n) , 



which implies that the sufficient statistic for the parameter is ni.k,n.jk,i, j = 1,2, k = 

1, . . . ,K, which are the marginal totals of the 2x2 table of (jlj), and X'n = (l^n, x'^n, . . . , x.'^_^n) 
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Now we consider the covariate matrix X. In this paper we consider the typical situation 
that the run sequence of the experimental units is allocated to each row of an orthogonal 
design matrix. For example, the run sequence of Table [1] in Section 1 is allocated to the 
2^ full factorial design. We write the orthogonal design matrix where the run sequence of 
the experimental units is allocated as K ^ p matrix D, where each element is +1 or —1. 
For example of Table [H we have 



D 



\ 



1 


1 


1 


1 


1 


-1 


1 


-1 


1 


1 


-1 


-1 


-1 


1 


1 


-1 


1 


-1 


-1 


-1 


1 


-1 


-1 


-1 



(6) 



1 / 



In this paper, we only consider the situation that each controllable factor has two levels. 
For later use, we write D = (dij) = (di, . . . , dp) where dj = {dij, . . . , dxj) € { — 1, +1}^ 
is the j-th column vector of D. We also define a simple convention 



1st 



and 



{disdu, ■ 
{disditdiu, 



duxd 



KsU'Kt 



• dKsdxtdK 



for 1 < s < t < u < p. 

The matrix X is constructed from the design matrix D to reflect the main effects of 
the controllable factors and their interactions which we intend to measure. For example, 
a simple model which only includes the main effects of each controllable factor is given 
as X = {Ik D). Of course, we can consider more complicated models containing various 
interaction effects. In particular, the saturated model includes K parameters. When K 
is a power of 2, the covariate matrix X for the saturated model is the Hadamard matrix 
of order K. In the case of 2^ full factorial design ([6]), for example, the covariate matrix 
for the saturated model is given as 



X = (Ik di d2 di2 ds dis d23 d 



123; 



(7) 



Since the saturated model cannot be tested, we consider an appropriate submodel of the 
saturated model. For the purpose of illustration, we again focus on the example of Table 
[U Since the analysis in Section 1 implies the model of the two main effects A, C and the 
interaction effect A x C, we treat this model as the null model and consider significance 
tests. Hereafter, we write this model as AC by the manner of the hierarchical models. 

This null hypothesis can be described by the parameter f3 as follows. Permuting the 
columns of ([7]), we partition the covariate matrix X of the saturated model as 



X = (Xo Xi), 

Xo = {Ik di da dis) = 

Xi = (da di2 d23 di23) 



[Ik xi X2 X3), 

= (X4 X5 Xg X7), 
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and consider the corresponding parameter j3 = (Pq, Pi, . . . ,Pt). Note that z/ — 1 = 3 in 
([5]) in this case. Then the null hypothesis is described as 

Ho : Pv = ■ ■ ■ = Pk-i = 0. 

Under the null hypothesis Hq, the nuisance parameters are Po, . . . , P^-i and the sufficient 
statistic for the nuisance parameters is written as 

{ui.k}, {n.jk}, i,j = 1,2; k = l,...,K, X^n. (8) 

Then by the theory of the similar tests, we can consider the conditional tests based on 
the conditional distribution of n given ([H]). 

Now we consider significance tests of null hypothesis Ho, against various alternative 
hypothesis Hi. Again for the purpose of illustration, we consider the example of Table [H 
In this case, an important alternative is to test the effect of a single additional effect, the 
main effect of B. This alternative hypothesis is written as 

Hi : P,^ 0, P,+i = ■■■ = Pk-i = 0. (9) 

Or we can also consider the goodness-of-ffi of the null hypothesis. In this case, the 
alternative hypothesis is written as 

Hi: {P, = ... = Pk_i)^{0,...,0). 

Depending on the alternative hypothesis, we can use appropriate test statistic T(n). For 
the alternative hypothesis written as ([9]), for example, a typical test statistic is a deviance 
function 

Uijk logT^, 

. . , ^ijk 

i,],k 

where and are the fitted values under Hq and Hi, respectively. Note that 
and n^k are calculated from the sufficient statistics under the hypothesis, i.e., 

{ui.k}, {n.jk}-, ^,j = l,2; k = \,...,K, X'^w 

and 

{ui.k}, {n.jk}, i,j = 1,2; k = l,...,K, X'^n, x>, 

respectively. In Section 4, we perform various tests for Table [U 

Finally of this section, we give a brief remark on the case that the design is fractional 
factorial designs. From the arguments above, it is obvious that our procedure is also 
applicable for the case of fractional factorial designs. All that we have to pay attention is 
the consideration on the aliasing relation when we construct a model including interaction 
effects. To illustrate, we again consider Table [H Suppose there is another controllable 
factor D. If we only consider eight-run design {K = 8), the main effect of D has to be 
confounded to some interaction effect of A, B,C, i.e., 2"^"^ fractional factorial design is 
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considered. When we define D = AC, for example, at most only one of the main effect D 
and the interaction effect A x C is estimable. Similarly, the interaction effects A x D and 
C X D are also not estimable when the main effects C and A exist, respectively. Then 
the resolution of such design is III. On the other hand, if we define D = ABC, we can 
estimate all the two-factor interaction effects, under the constraints that at most only one 
of (A X B,C X D), (A X C,B X D) and (A x D,B x C) is included in the model. The 
resolution of the design is IV. In Section 4, we consider such situations for Table [H 

3 Relation to the high-dimensional contingency ta- 
bles 

In Section 2, we give a general procedure to describe models by the covariate matrix X 
and the parameter /3, and to describe the sufficient statistic under the models. As we have 
seen, statistical tests are based on some discrepancy measure between the fitted values 
under the null and the alternative hypotheses, which are calculated from the sufficient 
statistics of the form ([8]). In this section, we give an interpretation of the sufficient 
statistics by considering the high- dimensional contingency tables. The main concepts of 
the arguments in this section are first shown in the previous work by one of the authors, 
Aoki and Takemura (2006). 

Full factorial designs When the experiment is allocated to the full factorial design, 
there is a direct correspondence to the high-dimensional contingency tables as follows. 
Suppose the design is 2^ full factorial design, where 2^ = K. In this case, we can treat 
the observations rijjfc, i,j = 1,2; k = 1,...,/^ as if they are the frequencies of 2^"*"^ 
contingency tables. To illustrate this point, we rewrite the cell indices of the frequency 
as nijaj^a2-ap, wherc ai, . . . , = 1, 2. Consequently, the observation of Table [H i.e., 
the case of p = 3, is written as follows. 



No. 


A 


B 


C 


nil 


ni2 


n21 


n22 


1 


1 


1 


1 


^11111 


nuui 


^21111 


^^22111 


2 


1 


1 


2 


^11112 


^^12112 


^21112 


^^22112 


3 


1 


2 


1 


^11121 


^12121 


^21121 


^^22121 


4 


1 


2 


2 


^^11122 


^12122 


^^21122 


^22122 


5 


2 


1 


1 


^^11211 


^12211 


^^21211 


^22211 


6 


2 


1 


2 


^^11212 


^12212 


^^21212 


^22212 


7 


2 


2 


1 


^^11221 


^12221 


^^21221 


^22221 


8 


2 


2 


2 


^^11222 


^12222 


^21222 


^22222 



Now we focus on the sufficient statistics under various models in this notation. For 
notation convenience, we use a, b, c instead of cti, 02, ^3 here. We have already seen that 
the marginal totals 
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are included in the sufficient statistic for every model. Under the main effect model 
A/B/C, the sufficient statistic is given as 

{^j-abc}) {^-jabcl^ {^ija--}^ {^ij-b-}j {^ij--c\- 

We know that this is the sufficient statistics of the hierarchical model 

MABC/yABC/MyA/MyB/MyC 

in the five- way contingency tables. On the other hand, under the model of AC, i.e., two 
main effects A, C and the interaction effect A x C, the sufficient statistic is given as 

which is the sufficient statistic of the hierarchical model 

MABC/yABC/A/yAC 

in the five-way contingency tables. In the same way, all the hierarchical models of the 
effects of the controllable factors A, B, C can be characterized as the corresponding hier- 
archical models in the 2^ contingency tables. We give the relations in Table HI Similarly, 

Table 4: Hierarchical models of the effects of the controllable factors A, B, C and their 
corresponding hierarchical models in 2^ contingency tables (2^ full factorial design) 
Models for A, B, C Models for M, y, A, B, C 



A MABC/i/ABC/M?/A 

A/B MABC/yABC/MyA/MyB 

AB M ABC /yABC/ My AB 

A/B/C MABC/yABC/MyA/MyB/MyC 

AB/C M ABC /yABC/ My AB/MyC 

AB/AC MABC/|/ABC/M|/AB/M|/AC 

AB /AC /BC MABC/yABC / My AB /My AC /MyBC 



we can consider full factorial designs with 16 runs, 32 runs and so on. All the hierar- 
chical models of full factorial designs with 2^ runs can be treated as the corresponding 
hierarchical models in 2^^+^ contingency tables. 

Fractional factorial designs Next we consider the case of fractional factorial design. 
Again we consider the design with 8 runs for illustration. In the case of p = 4, it is natural 
to define the aliasing relation as D = ABC since this gives the design of resolution IV. 
The observation is written as follows. 
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No. 


A 


B 


C 


D 


T) 1 1 
/til 


"-12 


"21 


"-22 


1 


1 


1 


1 


1 


^11111 


^^12111 


"21111 


"-22111 


2 


1 


1 


2 


2 


^11112 


"-12112 


"-21112 


"-22112 


3 


1 


2 


1 


2 


^1121 


"-12121 


"-21121 


"-22121 


4 


1 


2 


2 


1 


?T'11122 


"-12122 


"-21122 


"-22122 


5 


2 


1 


1 


2 


"11211 


"12211 


"21211 


"22211 


6 


2 


1 


2 


1 


"11212 


"12212 


"21212 


"22212 


7 


2 


2 


1 


1 


"-11221 


"-12221 


"-21221 


"-22221 


8 


2 


2 


2 


2 


"-11222 


"-12222 


"-21222 


"-22222 



In this case, because of the relation D = ABC, some hierarchical models of the controllable 
factors A, B, C, D does not have a corresponding hierarchical model in 2^ contingency 
tables. For example, the sufficient statistic for the main effect model A/B/C/D is written 
as follows. 

{"-i-abc}) {"--jabc}) {"-ya--}) {^ij-b-}i {^ij--c}i 

{"-ijlll + "-jjl22 + "-ij212 + "-y22l}, {"-yll2 + "-ijl21 + "-y211 + "-jj222}, 

which does not correspond to the sufficient statistic for any hierarchical model in 2^ 
contingency tables. Similarly, the sufficient statistic for the model AB/C/D, i.e., the 
model of the four main effects and the interaction effect A x B, is written as 

{^i-abc}) {^-jafec}) {^ijab-}j {^ij--c\j 

{nijiu + ?^yi22 + n'ij2i2 + n'ij22i}, {"-^112 + "-1^121 + ?^y2ii + "-^222}, 

which again does not correspond to the sufficient statistic for any hierarchical model in 
2^ contingency tables. Note here that the set d'^^i, d2n}, i.e., 

{nija-}, {nijb}, {"-yii- + "-ij22.}, {niji2. +nij2i.}, 
is simply written as {"-ijab } by the relation 



n 



ijab- — 



(10) 



where {a, a*} and {b,b*} are the distinct indices, respectively. We see that only the 
saturated model AB/AC/BC/D among the models including the main effect of D has a 
corresponding hierarchical models of 2^ contingency tables. 

We also consider the case of p = 5, 6. If there are 5 controllable factors, it is natural 
to define the aliasing relation as D = AB, E = AC, which yields the design of resolution 
III. In this case, the sufficient statistic for the main effect model A/B/C/D/E is written 
as 

{"-j-obc}) {^■jabc}i {^ijab}i {^ija-c}i 

which is the sufficient statistic for the hierarchical model MABC/yABC/M|/AB/M?/AC of 
2^ contingency tables. Similarly, consider the models containing interaction effect. Prom 
the aliasing relation, the estimable interaction is B x C, B x E or C x D, where the later 
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two are also confounded. We see that the sufficient statistic for the model A/BC/D/E is 
written as 

{^i-abc\ ^ {^ jabc}^ {^ijab-}^ {^ija-c\ {^ijbc\ ^ (■^■^) 

which is the sufficient statistic for the hierarchical model M ABC / y ABC / My AB/ My AC /MyBC 
of 2^ contingency tables. On the other hand, the sufficient statistic for the model 
A/BE/C/D is written as 

{iT'i-abc} i {^-jabc}) {^ijab-}^ 

{nijlU + niji22 + nij212 + ^jj22l}, {^jjll2 + ^ijl21 + nij2U + nij222}, 

which does not correspond to the sufficient statistic for any hierarchical model in 2^ 
contingency tables. Finally, in the case of p = 6, consider the design defined as D = 
AB, E = AC, F = BC. In this case, the sufficient statistic for the main effect model 
A/B/C/D/E/F is written as flTT]) . which is also the sufficient statistic for the hierarchical 
model MABC/?/ABC/M?/AB/M?/AC/M?/BC of 2^ contingency tables. 

In the same way, we can consider the fractional factorial designs with 16 runs, 32 runs 
and so on. The arguments and results are almost similar. For example, if some controllable 
factor F is defined as F = ABC, the sufficient statistic for the model containing the main 
effect F includes the marginal total of the type that some three-way marginal tables {riijk} 
is written as 

nni + niu + ?^2i2 + ^221, ^112 + ^121 + ^211 + ^222- 

We see that, if all the two-way marginal tables {riij.}, {n^.^}, {n.jk} are given, then all the 
three-way marginal totals {fiij^} can be derived from the similar relation to fllOp such as 

^111 = ^ [3(?2ii. + ni.i + n.u) + (n22. + n2.2 + n.22) 
o 

-(niii + ni22 + ^212 + ?^22l) - 3(^112 + ni21 + 7^211 + n222) ] ■ 

4 Numerical examples 

In this section we investigate the data of Table [H As we have seen in Section 1, a 
simple ANOVA analysis suggests the interaction effect A x C. Therefore we perform the 
statistical test for the null model A/B/C against the alternative model AC/B. As we 
have seen in Section 3, these hypotheses are equivalent to the models of 2^ contingency 
tables, M ABC / y ABC /My A /MyB/MyC (null model) and M ABC / y ABC /My AC /MyB 
(alternative model). The fitted values for these models are given in Table HI 

The likelihood statistic is calculated as 13.06 with degree of freedom 1. Therefore we 
have a conclusion that the null model is rejected (p = 0.000301) and the interaction effect 
A X C is statistically significant. To show the efficacy of our procedure, we also give an 
imaginary data set of Table [3l The fitted values are given in Table H] in this case, and 
the likelihood statistic is 11.56. Though this result also suggests the significance of the 
interaction effect A x C, the p value increases to p = 0.000674. 
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Table 5: Fitted values of Table [T] under the null model A/B/C (left) and the alternative 
model AC/B (right) 













null model 




alternative model 


No. 


A 


B 


C 


nil 


ni2 


^21 


n22 


nil 


ni2 


^21 n22 


1 


1 


1 


1 


27.7 


12.3 


10.3 


9.7 


26.7 


13.3 


11.3 8.7 


2 


1 


1 


2 


24.1 


15.9 


3.9 


16.1 


25.2 


14.8 


2.8 17.2 


3 


1 


2 


1 


19.0 


21.0 


6.0 


14.0 


17.3 


22.7 


7.7 12.3 


4 


1 


2 


2 


13.2 


26.8 


3.8 


16.2 


14.8 


25.2 


2.2 17.8 


5 


2 


1 


1 


39.0 


1.0 


13.0 


7.0 


40.0 


0.0 


12.0 8.0 


6 


2 


1 


2 


39.2 


0.8 


8.8 


11.2 


38.1 


1.9 


9.9 10.1 


7 


2 


2 


1 


38.3 


1.7 


12.7 


7.3 


40.0 


0.0 


11.0 9.0 


8 


2 


2 


2 


38.5 


1.5 


8.5 


11.5 


36.9 


3.1 


10.1 9.9 



Table 6: Fitted values of Table [3] under the null model A/B/C (left) and the alternative 
model AC/B (right) 













null model 




alternative model 


No. 


A 


B 


C 


nu 


^12 


n2i 


n22 


nil 


^12 


n2i n22 


1 


1 


1 


1 


27.2 


12.8 


10.8 


9.2 


26.7 


13.3 


11.3 8.7 


2 


1 


1 


2 


24.4 


15.6 


3.6 


16.4 


25.3 


14.7 


2.7 17.3 


3 


1 


2 


1 


19.1 


20.9 


5.9 


14.1 


17.3 


22.7 


7.7 12.3 


4 


1 


2 


2 


13.3 


26.7 


3.7 


16.3 


14.7 


25.3 


2.3 17.7 


5 


2 


1 


1 


9.7 


0.3 


3.3 


1.7 


10.0 


0.0 


3.0 2.0 


6 


2 


1 


2 


19.6 


0.4 


4.4 


5.6 


19.1 


0.9 


4.9 5.1 


7 


2 


2 


1 


38.0 


2.0 


13.0 


7.0 


40.0 


0.0 


11.0 9.0 


8 


2 


2 


2 


38.7 


1.3 


8.3 


11.7 


36.9 


3.1 


10.1 9.9 
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5 Discussion 



In this paper, we give a general testing procedure to investigate the main and the in- 
teraction effects of the controllable factors in the two- valued input-output systems. For 
this type of data set, simple ANOVA model for the standardized SN ratio is widely used, 
which is a proposal of Taguchi method. However, since the standard SN ratio is only a 
function of the sample odds ratio, we cannot evaluate the influence of the sample size 
of the data appropriately in the simple ANOVA model. In contrast, since our method is 
based on the conditional distribution for the various null models, sample size is considered 
in p values. 

Note that we do not deny the ANOVA model completely. It is unquestionable that 
the simple ANOVA model is useful in applications. However, it seems that the ANOVA 
model for the standard SN ratio is introduced heuristically. We believe that we have to 
investigate the theoretical vahdity for the Taguchi method carefully, and modify it as the 
need arises. We think that our procedure in this paper makes some contribution in this 
fields. 

Though we only give an illustration of the likelihood ratio test based on the asymptotic 
distribution in Section 4, various exact procedures or Monte Carlo procedures are also 

possible. See Agresti (1992) for the exact tests and Aoki and Takemura (2006) for the 

Markov chain Monte Carlo tests, for example. 
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